2D 109 719 



DOCOHENT RESOrl^ . 

CS 501 089 



AUTHOR Scott, Michael 

7I^X,E A Critique of Theoretical Contributions in ^ 

Instructional communication. 

NOTE^**^^ Up.; Study prepared at West Virginia University; Not ^ 

available in- hard copy due to marginal, legibility of 
original document 

ErrPS PBICE MF-$0.76 PLUS POSTAGE. HC Not Available f^om EDRS^ 

DESCBIPTOPS 




♦ Simulation;; Teaching Methods 



ABSTRACT 



In "Theoretical Contributions in Instructional 
communication," a survey was presente'd concerning the extent to which 
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A CRIT'QUE OF THEORETICAL 
COtlTRIBUTIOt^S m INSTRUCTIONAL C011Ml*^ICATI0H 

God only knows, I.^/fe spent a sood many sleepless nl^.ts wonderinc about what 
parents micht say if they entered a basic communication course and discovered their 
angelic daushter cropins with some lusting undergraduate male in the ••Between the 
Sheets" e.:ercise. By the sarae token, the same ..erson on high knous that I've tossed 
and turned a ^ood many nights as I've tried to imagine what parents micht say IL they 
entered the same course and Tound their blue-eyed male child who had never been 
clbser to a black than the pages of an old issue o£ National Geo^ra^ shouting 
obscenities at some fictitious slumlord as he convincingly role-played the first- 

born of Huey We\rt:on» 

irnile they might say -and for this we pay 1500 big ones a year,- I think I can 
conclude with some degree of certainty that one wouldn't turn to the other and say, 
../Jia-you see, dear, Professor Smith employs the cr^tive, experiential, concep- 
tualization and concept formation through inductive reasoning with existential 
implications method of teaching communication.- The point I'm trying to make here 
is about subtle as Richard Nixon's offer of the Directorship of the F.B.I, to 
Federal Judge tiatt Byrne while he was presiding over the trial of Daniel Ellsberg. 
Iligher education is currently being attacked on the grounds that it has never been 
accountable to the 190 million people or so who support it. l^^d the attackers 
have made it perfectly crystal clear that those of us involved with higher 
education had better make ourselves accountable if wc are to expect the monetary 
and attitudinal sup,>ort that we have enjoyed in the past to continue. 

llow, in my mind, the issue of accountability hold. Important inplications 
for thonc o: us In the buciness of human communication. Because ve t-nditionally 
have boon vulnerable to this kind of attack. And lately, I've come to the conclusion 
that wc r.ce presently and particularly vulnerable in terms of our classroom 

Go, it W.1G ulth somc^measurc of excitation that I approached the task of 



readiiic and evalaatinc n-oJressors Choathan .^.nd liricltsonts survey conceminc the 
extent to which "so called" conmunicat ioa cnmcs are bein^ used in our conmunlcat Ion 
clcssroons. 

To besin with, then," I would liltc to concratulate Professors Cheatham and 

Erickson Cor takinc on an issue that needed to be conironted. miile they do not 

come richt out and say it, I was left with the imp.-osslon that they ^;ere both 

concerned with ;;hether oi: not the numerous communication games and simulations 

tLt are bein- used in our classrooms arc peda-ocically justified. I share and 

» 

applaud that concern. 

Toward that end, the authors surveyed a sample of the Speech Communication 
Association membership. The survey itself was desicned to elicit member responses 
to a number of questions conceminj the use and justification of communication 
Camcs in the classroom. I think, for the most part, these questions ;7ere 
conceptually sound. But I have sone reser«.at ions about whether the survey ;/as 
desicned in such a way thct unequivocal ans^.er or answers representative of 
communication educators to the most sisnificant questions could realistically be 

obtained. For example: 

-rnich type of pameo arc utilized ? In my mind, an unequivocal or representative 
answer to this question was impossible for t;/o reasons. First, the authors arbi, 
trarily (I think) limited the number and types of yames available to the respondent. 
How are wo to kno;^, then, ;/hether the response is a true indicant of the most 
widely utilized cames or an indicant of the most widel- utilized s^-^nes amon- those 
available to t\\c respondent? 

The answ r, quite simply, is that ;/e do not know because v;e can't be certain 
that the ;ivc types of names available to respondents constitute a representative 
sample of the universe ol games that are presently available. Second, the types of 
cameo avaiU'ble to the respondnet were semantically rich. Tliat is, I think uhey 
nay very well have elicited differential meaninc from the respondents. To infer, 
consequently, that the 293 respondents indicating they used reality simulation 



held identical mccninc Cor the comcopt is unur.rrantod, and, therefore, the responses 

are uninterprctcible#, 

..fhv do instructor, u.c cormiunication >.ameG ? The same criticisms are applicable 
to the responses to thi. question. Aaain, the authors artitrarily limited the 
number oZ rationale lectors available to respondents. Upon what basis! Asain, 
there is no guarantee that these rationale factors elicited identical or even 
similar n^canins in the minds of the respondents. Their o.m .data, in fact, support 
this concludion. The responses to the open-enxled questionnaire item, ^or ezcample, 
do not necessarily "echo" the most frequent response to the question of why 
(because they are a superior method of clarifying); althoash the authors have 
interpreted them as such. Uo;; am I or anyone else ;;ho reads the paper to knou 
whether the authors* interpretation of' one subject's response that "an ounce of 
experience is ^.orth a ton of talk" or another's that "leaminc to^do by doins" is 
accurate ia this regard? In short, tup responses that possibly "echo" the most 
frequently cl.osen'rationale factor do not warrant tUe conclusion that is draw, 
(sec ps« 4)« 

• instructor, evaluate stur l-n^.. participation in communical(cm^ames? 

While the preceding criticism.^ also apply here, I uould like to say somethins about 
the functional utility of the responses to this question. Given the nature of th. 
questionnaire item and the limitations in the types of responses that could be 
elicited, tl>e authors u.:rc rior^'cr Ic. ZorcC t. conclude littl: I.eyon-^ the fact 
t:>at all typos of evaluation nethodolocies are used; cither by themselves or in 
conjunction uith others. Jhile I don't mean to sound denisratinc, I can't help 
but grander ;;:>ether the responses to this question are pedasoGically useful. I 
think they could have been ... that is, if the questionnaire item had. been desicned^ 
in such a ury that It ..-ov.M have enabled the authors to conclude somethins about 
the specific type and form of evaluation whether it be peer, instructor, pencil- 
paper, or sono combination of evaluative techniques. Also, this kind of information, 
when cou,led with the i:.:cn.ation whiqh the authorr. did receive, micht have been 



useful Tor comparative purposes, 

llhich co.Timunication concepts are curr e ntly bein.^. tcurrht throup^h cotnmunication 
£ames? TI.c ciuestloa oZ raeaniro is particularly sicnificant to this questionnaire 
icem. For e.:^.inple, did ti.e authors deline in the questionnaire uhat they meant by 
"concept?" ir they didn't then how can' they he sure that the 6G respondents indi- 
cating nonverbal cotnmunication or any other topic area had the same concept in 
mindZ Fo_- er.^mple, while the concept nonverbal coomunication could mean comnuaicatin 
without verbal symbols in general, it could also mean cotmunication through the use 
ol boc'y, s..c.ce, time, or touch. But again, wc really have no reliable way of 
lcnov;in;^ t'ii^» 

-Thilo I thinl; that these criticisms also speak to the question recardinc: 
criterir. lor sclectinc; a particular cja.r.c, I would lilcc to ..wve on to sone nethodo- 
rigical issues. 

Sanplej I question whether the sample utilised in this study wa. represcnta- ' 
tive of the membership oZ the 3C:.. Miat do we !:now, lor e::ample, about tha popu- 
lation rrom which the sample "as dra.m? ProbaMy very little bcyom^ the lact that 
it is highly heteroi;enou3 - made up o: a number o.: divisions with divergent 
. interests, methods, and pedagogical goals 3ince we do not hnow whether there arc 
dlirercnccs between these divisions as a function o: teaching style or other rele/ar. 
variables, it is inappropriate to collapse across these divisions to derive one 
population. Yet, that Is er.actly what occurred in this survey. The merabership c£ 
the 3C/. was treated a. one population x;hen it may very well be that the 3CA is raade 
up o' uany dif.erent populations, as a result, a stratified sample r.u.y have been 
noi:2 a)prorjiatG than a jranflom sample. 

Oonr.tructLon of rUo. cjuestionnaire items . IJich of the criticism in the first 
part of thL-, critique is predicated on the assumption that the questionnaire items 
used in thir, survey were intuited rather than derived in some systematic fashion 
(e.g., independent panel oZ e::pert'.). If that is in Inct the case, then surveyor 
bla. severely nitlgntes again.t the toprcsentativen-ns of the response- to t'^e' . 



questionnaire. ' 

The items facmsolvcr, . I can synpatl.ize with the dirficulties two researchers 
automatically impose upon themselves when they decide to conduct a larae scale survey 
AS a result, I c.n understand why the authors strived to malce the raslc of completing 
the questionnaire as easy as possible. However, when they assume this Iclnd of 
research postare,they also run the risk of comproninins the representativeness of 
d^clr survey results. For example, I ara somewhat puzzled by tl.ei-r decision to employ 
items tnat were limited to categorical replies as well as their failure to aslc 
respondents to, rank-order their replies where appropriate (e.g., questlono 2, 4, 5, 
6, and C). I think the meaninglulness of the survey results could have been slg- 
nlficantly enhanced if the questionnaire items had been constructed in such a way 
that Interval data could have been obtained or, if this were impossible (I don«t 
think it is), to have respondents rank-order their replies. 

Attitude Scales. Finally, one item attitude scales such as those employed in 
this study are notoriously unreliable (Kcrlinger, 1054). As a result, the responses 
to these scales may not be representative of teacher, student, or colleague attitud. 
concerning co,x.unication games. That is unfortunate beccuse represnetativ. findiPgs 
in this regard would have been very usefuK 

In sum, I think the authors started out with sotne good c.uestions that needed 
to be' answered, but failed to design their survey In such a way that they could 
obtain re presentative answers to the questions. However, in my mind, that is ^.hat 
research is all about. 'le learn a. a function of both our successful studies anc' 
our not so successful studies. Md, in ny case, the latter much more true than 
the romor. 

In closing, I hope you find at least part of this constructive. It hac not 
been my intention to att.cl: but to probe and I hope the preceding criticism is so 
perceived, .^.^.-way, I f.ink a duplication of their effort is warranted and that 
they should be r.pplaudcd for attempting to study something, that is very difficult 
to ncAl f'o\n\. 
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I think IIS. Ilnyne^ paper conccnUna the in^lcncntatlon of a nuistery learning 
system oZ instruction aloo has sonethina to say about the state o£ our cornnninlcation 
classrooms. On the whole, there Is v.ry little to quarrel about with respect to 
the intentions o.' this paper. Ilastery leamina i= indeed a desirable instructional 
approach - one that is compatible with both the coal= ol teachers and the current 
holders oI f,e purse strinc^ hiding behind the banner ol accouatability. And. I 
as-.-ee vith li. Ila^mes. conclusion that time constraints imposed by the academic 
calender do not or should not preclude tha possibility ol impleraentinc mastery 

learning in any classroon. 

criticis;:. ol the paper, consequently, is not so much concerned with what 
IIS. llc'.-ncs did advocate as with what she did not advocate. But let nc eicnlain. 
In the c^innias oL this paper. I think some .mwarranted conclusions are drcxm - 
conclusions that ia my mind nisht prove misleadina Tor the naive reader.' /^.d I 
think they set the tone oZ the entire paper. For e::amole. consider the loUowinp. " 
conclusions taken from the first pace of lir.. Ila^-ncs' papert 

"I. actuality, there are tuo xrays to set uy a mastery learning system." 
To oaraphrasc. one in which the students are allowed unllmitea time to 
acciuire certain skills and one in which students dcpendin:-. on taci. 
individual skills, attempt to acquire varying skills within a constant 
amount ol time. 

."/ar-'inc the n-Woer ol skills to be acquired \s particularly appropriate 
to cla.se; sSch as public speaking, .rhn-n r.nrlK-:-. roco^mize -the <^-^^;^^^y. 

rtu'ents' ca.^abillttgr; And do not ^-^^ s^-^- t'^r-.r-o 

prof lv:lencV »" 

A number of things need to be said resardinc the precedins statenentc. First, 
they are hlnhly rusleading iZ not incorrect. As a case in point, there are several 
nodiricatio^.r. oZ mastery leanUns systems - any oZ which can be elective iZ sys. 
tenatLcall.- developed. But that is not nearly as troublesome as the second con- 
cl.islo:. in -./hich Ifc. Hnynes assorts that public speaking tvnchcrs somehow or the 
other are setter equippo.d tl>an other kinds oZ teachers to Assess student abilities 
and are perhaps mre sensitive to the fact that students shouldn't be e::pectocl to 
achieve at the same level. Aside Irom the Cact that this conclusion seems to b3 



inconsistent with one goal oZ mastery learnins - i.e. having all students meet a 
high criterion level ^ it i. contrary to what one would be led to believe on the 
basis o: research. Experiments concerned with the so-called "expectancy elfect," 
for example, sugscst that teachers are more than capcble of erroneously judsins a 
student's ability and that these erroneous judcraents often impact on a student's 
flcliievament throushoat a course (Rosenthal and Jacobson, 106C, tlcichcnbaum. Bowers, 
and Ross, 1969; aubovits ar.d IIalier,"l971). If that wore not enouch. there is 
considerable evidence in support of the notion that teachers often mistake physical 
ot psychological disabilities that nay impair achievement for something they are 
not (Gilvcrraan, 196C). /.draittedly. this research did not focus on speech teachers 
specifically. But why should .1 or any other reader of this paper conclude that 
, public speakiug teachers are e::ampt from making bad judgnents? 

Uhat I am attempting to say here is that the preceding conclusions misrepresent 
the facts. i\nd I think this kind of misrepresentation occurs throughout the paper. 
■Thy is that? rell, in answer to rrry o.m question, I think !ls. llaynes mnde a very 
conscious attempt to explain mastery learning and how it might be implemented in 
such a ^;ay that the naive reader would not be bowled over by the jargonese ol the 
instructional technologists. Tlunt is to be applauded. Cut in the process, I think 
she over sinvUficd both mastery learning and the task of implementing mastery 
learning in any classroom - regardless of the subject matter being taught. Thus, 
I am sonewhat afraid that a naive teacher might read this paper, conclude that he 
or she has an adequate understanding of mastery learning, and decide to ii^oplement 
a mastery Icarr.ing systcin in accordance with the dictates of the paper. But the 
truth of f'.e matter is that he or she wouldn't have an adequate understanding 
because f.o paper fails to address some crucial issues concerning mastery learning 
t!iat are inl'.aront to it?, understanding. 

Let'.-, begin with the issac of why raastery learning is superior to other 
pedagoglcrl approaches. In my mind, the advantage o,: any mastery learning program 
Lr; that Jt raquiros students to master a specified nurabar of behaviors Judged to be 



essential to tl.e nubjcct at hand. By master, however, I am not tallcins about 
student, achievinc a hq.. or "C-", which Ms. Haynes. I assume, thinks is proof 
cnou3h o: mastery. Instead, I am talUin^ about students meetins some specified 
criterion, usually someuhere in the neighborhood of CO per cent of the specified 
attributes of the' behavior, /otd that, quite frankly, is "hy mastery learninc can 
be a superior podaaoslcal approach. Its purpose is not simply to eliminate 
failure, but to ma::Imize successes and a -C. or "C-" is not an indicant of success 
Dut this brinss up yet another issue that lis. Ilayneo failed to address or wan. 
her readers about. 

A .aastery learning system is only as good as the criterion-refereaced system 
of sr^in, that accompanies it. Md cood criterion-referenced systems of srndine 
are about as easy to come up uith as truly non-se::ist males. And this is true 
in hard science subject matters ouch less public s^eahins courses. In short, I 
think It vas her c'uty to uarn the readers that if tjhey couldn.t establish a 
reliable and valid cviterio..-ref erenced cradinc system that it would be a waste 
of both their and their students, time to attempt to f»n.ulate and ir.^,lar.^nt a 
naotery Inaminc sy'-tcn of instruction. 

rue isoue of 3radin3 Is further confounded by the way in which a teacher 
deci.'es which behaviors are essential to the development of his or her students. 
Ilee.:ier.r. to say, I don-t think that a teacher should rely solely on experience 
uhen it co.nes do.m to decidinc which behaviors all students must master. H.nt 
this succ;ests, then, is that a teacher approach this task in some systematic 
fashion - per:..ps an audit or ta::onony,, of essential behaviors. If they do not, 
acain somethins Us. Haynes failed to warn about, there is no cuarantee that the 
beliaviors tlicy require students to master are wortli mastering. 

F^.ally, I think teachers .;ould be doin^ their students a treiaendous dis- 
service if they attempted to intuit -the strengths and needs of students, identJ 
[yinr. stud.nts for academic crouplnss and to serve as len^lers of croups." Teach 
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have rbout the scs^a reliability in tliis record as one-it or. tacasurcmct scales. 
AST. result, I thini; teachers would be better advised to seel: out e:cistins diagnostic 
v"S'e\:yecrSo'itions tounrd varying instructional nethods and content. anM 
certainly levels ol apprehension associated uith oral comunication. I make 
raention o.: the latter because ny o.m^ research su-est. that learner history may 
sisnificantly ellect conatlvc and allective behaviors in the type oZ instructional 
systera that yon advocate. By assessins them prior to entering the instructional 
system, a teacher is placed in the advantageous position ol being able to control 
them. 

I.i Eun, I do not disagree uith '.;hat is said in the paper. I object, quite 
simply, to uhat is not said in the paper - and that could easily be rectified. 

Belorc tun^ing to the Todd et. al. paper, I uould lilce to say something about 
Bill *,-■.<'. I£i: tuct am some seven yoa.-s ago while we were both undergraduates at 
California ::tate U-niversity at Long Beach. Unlike -.ae, Bill was e:ctrcmely con- 
cientious as an undergraduate - so much so, in fact, th t Ton Young and I liad 
to drag Uim by the hair alter clasnes to partake o: the hop's.' After receiving ^ 
this paper, which was difficult to carry nuchlcss critique, I am convinced that 

he hacn't changed. ^ 

Ihy comments about this review of the diffusion literature are based on the 

following criteria: 

1. Jas the review comprehensive? 

2. Jas the review well written, organized, and documented? 

3. .JnL the review critical in nature or was it a simpl'-, summary oi research? 

4. the review systematic; that is, in the sense that it organi/.ed research 
r.uch a way that it might suggest por-tuL-.tcs or principles, laws, or 

J. -a^;} the revie\^ IiGurir.tic? 

C.itorion 1 . I think I can safely say that this review is comprehensive. 
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i£ not more so, than any review it has been my pleasure to read. I thlnU the author 
are to be commanded, moreover, for attempting to int-rate literature that In the 
past has only been tanaetlally related to research concerning the diffusion of 
innovations, with literature reviewed in, extant sources su:h as Rogers and Shoemaker 
Criterion 2. Given the unu^Sal format of this review, I tMnlc the authors did 
an admirable job of writing. It is by no means an easy task to synthesize literatur 
and present it in a comprehensible manner - something I think a good many people 
in this discipline overlook. By the same token, the task of abstracting a study, 
think-plece, or review so that they remain semantically intact is far from being 
a push-over. And to a lavge' e^ctent, I think that this review was m»re than 
satisfactory with respect to both tasks. 

Uuile the organi^atiot. of the paper set well with mo, I think it could con- 
ceivably get in the way ofi the content for some readers. Uhy is that? Uell, a 
review ol the literature organized such as this is far from typical, /md I am 
afraid that some readers might be turned-of f to it because they are unaccustomed 
to processing information as it appears in this paper. Speculative as that 
initially may seem, I think it is tenable. As a result, the authors n.ight want 
to subject portions of the content to measures of readability and/or satisfaction. 
Ity o..m research, though still in the exploratory stages, suggests that various 
methods of presenting content elicits differential levels of satisfaction and 
that there may be some causal linkage between .'atisf action and com,>rehension. 
needless to say, the paper is well documented. 

criterion 3. In ny mind, there are at least two ways to look at the question 

of what constit.ces a critical review of the literature. The perspective that I 

,avc generally suhs.ribed to is rather straightfor-wnrd: a critical review of the 

literature is one in which the works that arc reviewed are conceptually and 

operationally criti.ued. In effect, this means that the reviewer makes editorial 

. consents a'^out the thesis or rationale of a particular work, v;hether stat^oments 

concerning possible relationcl.ip. a^e .uggcted as a function of the thesis or 

) 
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rationclc, wl.cther appropriate nethodolocics arc enploycd in the cllort to diGcem 
the nature oZ these relationships, and finally, whether the precedina have beeh 
do^ie in such a that the ' claitr.s, (I:nox7ledce or oChetvise) made in the ;;orh are 
justiricd. Ii^ my estimation, this revie;; ol the literature is not critical in 
this sense. 

But as I iiaid bcCore, there is at least one other type ol critical review. 
This' cetond perspective seems to be predicated ou the assumption that if one decides 
to review only that which is appropriate to the_ needs at hand, he or she has 
en3r.;.;ad in a criticisl process. I think this paper conforms to this description 
much more than the prccediuG one — and, I think this is a possible limitation 

in it. 8 • 

Criterion 4 and Criterion 5. I've decided to collapse these two because I . 
think that if you have met one, then the conclusion that you have met the othci' 
is inescapaulc. 

"iTow. I would like to say that this review is anything but systematic. By 
doinc so, I mislit je able to shield myself from the accusation that this critique 
is inocuous. But alas, I can't. The paper is not only systematic in thrust, it 
jLs systematic by desl-n. ■.\n;: I think that this is perhaps the true sc^-cncth of 
the paper. The nuthors havo formulated a model based upon weak^nesses of e::istins 
models, perused the literature in, the attempt to support the model, and .cept 
intact or revised certain asp'ects of the model as a function of the perusal. 

Finally, I think the review is heurfstic in the sense that the supporting 
literature su—ests causal linkasos bet;;een variables ia the diffusion process. 
At t>e saiac time, however, I do not think that these causal linkages or, perhaps 
more approp.-irtely, the relationships hetvcen the variables e.cplicatcd throughout 
the v...-ious stages of the model were made e;;plicit enough. If .hoy had been, I 

4 

' tliinl:' the revlen a.i'i the model could liave been significantly extended — so much 
so, in [n.t, that principUs or propositions concoraiuL the diiruaon o. educationrl 
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innovationG would not be IcEt to the deductive prox;css ol the reader. In short, 
I th.nk the ^d.l and review in su,.po|.-t of it have real- theoretic implicr.tionsj 
that is, iZ :iorc take Cull advantage ol the inplicit relationships the • 

model and review currently sucsest. K they do not, moreover, I think they run 
-the risk or eliciLinc a "so ^/hat" response ilroin nmny of those ;;ho mi^ht have the' 
inost to 3ain from readins this paper. . , 

As a :i«al note, I would like to say somethin- about the papers on this panel 
in tofco. In ny mind, eacli makes an honest attempt to c:;plain, modify, or extend 
the paraiieterG of' human communication instruction. ^ And since 1 think that human 
communication theory's real import is in the classroom, I find these attempts not 
only admirable, but worthy of modeling. 




